Sequence Labeling with Meta-Learning

نویسندگان

چکیده

Recent neural architectures in sequence labeling have yielded state-of-the-art performance on single domain data such as newswires. However, they still suffer from (i) requiring massive amounts of training to avoid overfitting; (ii) huge degradation when there is a shift the distribution between and testing. In this paper, we investigate problem adaptation for under homogeneous heterogeneous settings. We propose MetaSeq, novel meta-learning approach labeling. Specifically, MetaSeq incorporates adversarial strategies encourage robust, general transferable representations The key advantage that it capable adapting new unseen domains with small amount annotated those domains. extensively evaluate named entity recognition, part-of-speech tagging slot filling tasks experimental results show achieves against eight baselines. Impressively, surpasses in-domain using only 16.17% 7% target average settings, 34.76%, 24%, 22.5%

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multitask Learning for Sequence Labeling Tasks

In this paper, we present a learning method for sequence labeling tasks in which each example sequence has multiple label sequences. Our method learns multiple models, one model for each label sequence. Each model computes the joint probability of all label sequences given the example sequence. Although each model considers all label sequences, its primary focus is only one label sequence, and ...

متن کامل

Sequence Labeling with Reinforcement Learning and Ranking Algorithms

Many problems in areas such as Natural Language Processing, Information Retrieval, or Bioinformatic involve the generic task of sequence labeling. In many cases, the aim is to assign a label to each element in a sequence. Until now, this problem has mainly been addressed with Markov models and Dynamic Programming. We propose a new approach where the sequence labeling task is seen as a sequentia...

متن کامل

Semi-supervised Multitask Learning for Sequence Labeling

We propose a sequence labeling framework with a secondary training objective, learning to predict surrounding words for every word in the dataset. This language modeling objective incentivises the system to learn general-purpose patterns of semantic and syntactic composition, which are also useful for improving accuracy on different sequence labeling tasks. The architecture was evaluated on a r...

متن کامل

Semi-Supervised Active Learning for Sequence Labeling

While Active Learning (AL) has already been shown to markedly reduce the annotation efforts for many sequence labeling tasks compared to random selection, AL remains unconcerned about the internal structure of the selected sequences (typically, sentences). We propose a semisupervised AL approach for sequence labeling where only highly uncertain subsequences are presented to human annotators, wh...

متن کامل

Learning Discriminative Relational Features for Sequence Labeling

Discovering relational structure between input features in sequence labeling models has shown to improve their accuracy in several problem settings. However, the search space of relational features is exponential in the number of basic input features. Consequently, approaches that learn relational features, tend to follow a greedy search strategy. In this paper, we study the possibility of opti...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Knowledge and Data Engineering

سال: 2021

ISSN: ['1558-2191', '1041-4347', '2326-3865']

DOI: https://doi.org/10.1109/tkde.2021.3118469